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Abstract. This paper studies large dam models where the difference between 
lower and upper levels, L, is assumed to be large. Passage across the levels 
leads to damage, and the damage costs of crossing the lower or upper level are 
proportional to the large parameter L. Input stream of water is described by 
compound Poisson process, and the water cost depends upon current level of 
water in the dam. The aim of the paper is to choose the parameters of output 
stream (specifically defined in the paper) minimizing the long-run expenses. 
The particular problem, where input stream is ordinary Poisson and water 
costs are not taken into account, has been studied in [Abramov, J. Appl. 
Prob., 44 (2007), 249-258]. The present paper addresses the question How 
does the structure of water costs affect the optimal solution? Under natural 
assumptions we prove an existence and uniqueness of a solution and study the 
case of linear structure of the costs. 



A large dam is defined by the parameters L lowcr and L uppcr , which are, re- 
spectively, the lower and upper levels of the dam. If the current level is be- 
tween these bounds, the dam is assumed to be in a normal state. The difference 
L = L u PP cr — L lowcr is large, and this is the reason for calling the dam large. This 
property enables us to use asymptotic analysis as L — ► oo and solve different prob- 
lems of optimal control, which by a direct way, that is without using an asymptotic 
analysis, become very hard. 

Let L t denote the water level at time t. If L lowcr < L t < L uppcl \ then the 
state of the dam is called normal. Passage across lower or upper level leads to 
damage. The costs per time unit of this damage are J\ — j\L for the lower level 
and, respectively, J 2 = jzL for the upper level, where j\ and j% are given real 
constants. The water inflow is described by a compound Poisson process. Namely, 
the probability generating function of input amount of water (which is assumed to 
be an integer- valued random variable) in an interval t is given by 



where r$ is the probability that at a specified moment of Poisson arrival the amount 
of water will increase by i units. In practice this means that the arrival of water 
is registered at random instants ti,t%, . . . ; the times between consecutive instants 
are mutually independent and exponentially distributed with parameter A, and 
quantities of water (number of water units) of input flow are specified as a quantity 
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i with probability r, (n + T2 + • • • = 1)- Clearly that this assumption is more 
applicable to real world problems than the assumption of [2] where the inter-arrival 
times of water units are exponentially distributed with parameter A. For example, 
the assumption made in the present paper enables us to approach a continuous 
dam model, assuming that the water levels L t take the discrete values {jA}, where 
j is a positive integer and step A is a positive small real constant. In the paper, 
however, the water levels L t are assumed to be integer- valued. 

The outflow of water is state-dependent as follows. If the level of water is be- 
tween L lowor and L upper , then an interval between departures of water units (inverse 
output flow) has the probability distribution function B\{x). If the level of water 
exceeds L upper , then an inverse output flow has the probability distribution func- 
tion B2{x). The probability distribution function B2{x) is assumed to obey the 
condition xdB2 (x) < j. If the level of water is L lowcr exactly, then output of 
water is frozen, and it resumes again as soon as the level of water exceeds the level 
flower (The exact mathematical formulation of the problem taking into account 
some specific details is given below.) 

Let CL t denote the cost of water at level L t . The sequence c, is assumed to be 
positive and non-increasing. The problem of the present paper is to choose the 
parameter J Q xdBi(x) of the dam in the normal state minimizing the objective 

L uppor 

j = pi Ji +P2J2 + Ci *' 

i=£ lowo, + 1 



function 




(1.2) 




where 




(1.3) 


Pi 


(1.4) 


P2 


(1.5) 


Qi 



lim Pr{L t = L lowcl '}, 
lim Pr{L t > L u PP° r }, 

t— »oo 

lim Pr{L t = L lower +i}, i = 1, 2, . . . , L. 

t— > 00 

Usually the level L lower is identified with an empty queue (i.e. L lowor — and 
^upper ._ anc [ the dam model is the following queueing system with service 
depending on queue-length. If immediately before a service beginning the queue- 
length exceeds the level L, then the customer is served by the probability distribu- 
tion function B2(x). Otherwise, the service time distribution is B\(x). The value 
pi is the stationary probability of an empty system, the value P2 is the station- 
ary probability that a customer is served by probability distribution B2(x), and 
qi, i — 1, 2, . . . , L, are the stationary probabilities of the queue-length process, so 

L 

Pi + P2 + 1i = 1- (F° r the described queueing system, the right-hand side limits 

i—l 

in relations (|1.3p - (|1.5l) do exist.) 

In our study, the parameter L increases unboundedly, and we deal with the series 
of queueing systems. The above parameters, such as pi, P2, J\, J\ as well as other 
parameters are functions of L. The argument L will be often omitted in these 
functions. 

Similarly to [2], it is assumed that the input parameter A, the probabilities n, 
T2,. ■ .and probability distribution function ^(x) are given, while the appropriate 
probability function B\(x) should be chosen from the specified parametric family 
of functions B\{x, C). (Actually, we deal with the family of probability distribution 
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functions B\{x) depending on two parameters 5 and L in series, i.e. B\(x, 5, L). 
Then the parametric family of distributions B\(x,C) is described in the limiting 
scheme as 5L — > C, so the parameter C belongs to the family of possible limits of 
5L as 5 — >• and L oo.) 

The outflow rate, should be chosen such that to minimize the objective function 
of (|1.2j) with respect to the parameter C, which results in choice of the correspond- 
ing probability distribution function B\(x,C) of that family. 

A particular problem have been studied in [2], A circle of problems associated 
with the results of [5] are discussed in a review paper [3]. 

The simplest model with Poisson input stream and the objective function having 
the form J = p\J\ +P2J2 (i-e. the water costs are not taken into account), has been 
studied in [2]. Denote p 2 = A J °° xdB 2 (x) and p\ = px{C) = X J °° xdBi(x, C). 
(The parameter C is a unique solution of a specific minimization problem precisely 
formulated in [2].) In was shown in [2] that the solution to the control problem is 
unique and has one of the following three forms: 

(i) in the case j% = J2 i-„ 2 the optimal solution is pi = 1; 

(ii) in the case j\ > j'2 ^ 2 the optimal solution has the form pi = 1 + 5, where 
5{L) is a small positive parameter, and S(L)L — > C as L — > 00; 

(hi) in the case j\ < j'2 ^ g , the optimal strategy has the form p± = 1 — 6, and 
5{L)L — > C as L 00. 

It has been also shown in [2] that the solution to the control problem is insensitive 
to the type of probability distributions Bi (x) and B 2 {x) . Specifically, it is expressed 
via the first moment of B 2 (x) and the first two moments of Bi (x) . 

The aforementioned cases (i) , (ii) and (hi) fall into the category of heavy traffic 
analysis in queueing theory. There are many papers related to this subject. We 
mention the books of Chen and Yao [4] and Whitt [19], where a reader can find 
many other references. The aforementioned paper [2] as well as the present paper, 
however, are conceptually close to the well-known paper of Halfin and Whitt [6]. 
The heavy-traffic conditions in queueing systems with large number of identical 
servers arise naturally if we assume that a high-level, associated with the loss in 
that system, is reached with a given positive probability, while the traffic intensities 
converge to 1 from the below and the arrival rates and number of servers increase 
to infinity. In the case of the single-server state-dependent queueing systems of 
the present paper that model a large dam, we assume that the specified costs for 
reaching the lower and upper levels multiplied by the corresponding probabilities 
must converge to the given fixed values in limit, and the resulting functional con- 
taining these quantities must be minimized. This leads to the study of the family 
of systems under the heavy-traffic behaviour, in which the sequence of products 5L 
must converge to the optimal value C. 

Compared to the earlier studies in [5] , the solution of the problems in the present 
paper requires a much deepen and delicate analysis. The results of [5] are extended 
in two directions: (1) the arrival process is compound Poisson rather than Poisson, 
and (2) structure of water costs in dependence of the level of water in the dam is 
included. 

The first extension leads to new techniques of stochastic analysis. The main 
challenge in [5] was to reduce the certain characteristics of the system during a 

n 

busy period to the convolution type recurrence relation such as Q n = Q n -i+ifi 

i=0 
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(Qo 7^ 0), where fo > 0, fi > for all z > 1, fi = 1 an d then to use the known 

results on the asymptotic behaviour of Q n as n — > oo. In the case when arrivals are 
compound Poisson, the same characteristics of the system cannot be reduced to the 
aforementioned convolution type of recurrence relation. Instead, we obtain a more 
general scheme including as a part the aforementioned recurrence relation. In this 
case, asymptotic analysis of the required characteristics becomes very challenging. 
It is based on special stochastic domination methods, which will be explained in 
details later. 

The second extension leads to new analytic techniques of asymptotic analysis. 
Asymptotic methods of [2] do not longer work, and one should use more delicate 
techniques instead. That is, instead of Takacs' asymptotic theorems [17] . p. 22-23, 
one should use special Tauberian theorems with remainder by Postnikov [9], Sect. 
25. For different applications of the aforementioned Takacs' asymptotic theorems 
and Tauberian theorems of Postnikov see [3] . 

Another challenging problem for the dam model in the present paper is the 
solution to the control problem, that is, the proof of a uniqueness of the optimal 
solution. In the case of the model in [2] the existence and uniqueness of a solution 
follows automatically from the explicit representations of the functionals obtained 
there. (The existence of a solution follows from the fact that in the case p\ — 1 we 
get a bounded value of the functional, while in the cases p\ < 1 and p\ > 1 the 
functional is unbounded. Then the uniqueness of a solution reduces to elementary 
minimization problem for smooth convex functions.) In the case of the model in 
the present paper, the solution of the present problem with extended criteria (|1.2|) 
is related to the same class of solutions as in [2]. That is, it must be either p\ = 1 or 
one of two limits of p\ = 1 + 8, pi = 1 — 5 for positive small vanishing 6 as L increases 
unboundedly, and L5 — > C. While the existence of a solution follows trivially as 
in [2] , the proof of a uniqueness of the solution requires elegant techniques of the 
theory of analytic functions and majorization inequalities (see [7J and [8]). 

Similarly to [2J, we use the notation pij = X 1 f °° x l dB 1 (x), I — 2,3. The exis- 
tence of px,i (i.e. the moments of the third order of Bi(x)) will be specially assumed 
in the formulations of the statements corresponding to case studies. 

It is assumed in the present paper that Ci is a non-increasing sequence. If the 
cost sequence e, were an arbitrary bounded sequence, then a richer class of possible 
cases could be studied. However, in the case of arbitrary cost sequence, the solution 
need not be unique, and arbitrary costs Cj, say increasing in i, seem not to be useful 
and, therefore, are not considered here. A non-increasing sequence Cj depends on 
L in series. This means that as L changes (increasing to infinity) we have different 
non- increasing sequences (see example in Section [Jj). The initial value c\ and final 
value cl are taken fixed and strictly positive, and the limit of cl as L — > oo is 
assumed to be positive as well. 

Realistic models arising in practice assume that the probability distribution func- 
tion Bx{x) should also depend on i, i.e have the representation B 1 ^ i (x). The model 
of the present paper, where B\{x) is the same for all i, under appropriate addi- 
tional information can approximate those more general models. Namely, one can 
suppose that the stationary service time distribution Bi(x) has the representation 
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L 

B\(x) — QiBi,i(x) {q%, i — 1,2, ... ,L are the state probabilities), and the so- 

lution to the control problem for Bi(x) enables us to find then the approximate 
solutions to the control problem for Bi ^x), i = 1,2, ... ,L by using the Bayes rule. 
For example, the simplest model can be of the form B\{x) = aB*(x) + fo_B**(x), 

L° L 

where a := ^ % (L < L), and, respectively, b := Y Qi- 

i=l i=L«+l 

In the present paper we address the following questions. 

• Uniqueness of an optimal solution and its structure. 

• Interrelation between the parameters ji, j2, P2, c% {i = 1, 2, . . . , L) when the 
optimal solution is p\ = 1. 

The uniqueness of an optimal solution is given by Theorem 16.41 In the case 
of the model considered in [5] the condition for pi = 1 is j\ = j 2 \ P - P ^ ■ Intuitive 
explanation of this result is based on the well-known property of the stream of 
losses during a busy period of M/GI/l/n queues, under the assumption that the 
expected interarrival and service times are equal (see Abramov [T], Righter [TU] 
and Wolff 22 J. In the case of the model in this paper the interrelation between 
the aforementioned and some additional parameters involves the inequality (see 
Section [6j Corollary 16. 5|) . Exact results are obtained in the particular case of 
linearly decreasing costs as the level of water increases (for brevity, this case is 
called linear costs). In this numerical solution of the problem is given. 

The rest of the paper is organized as follows. In Section [2] the main ideas and 
methods of asymptotic analysis are given. In Section \2~T[ we recall the basic meth- 
ods related to state dependent queueing system with ordinary Poisson input that 
have been used in [2] . Then in Section 12.21 extensions of these methods for the 
model considered in this paper are given. Specifically, the methodology of con- 
structing linear representations between mean characteristics given during a busy 
period is explained. In Section [3l the asymptotic behavior of the stationary prob- 
abilities is studied. In Section [3. 1[ known Tauberian theorems that are used in the 
asymptotic analysis in the paper are recalled. In Section 13.21 exact formulae for 
the stationary probabilities p\ and P2 are derived. On the basis of these formulae, 
in Sections 13.31 and 13.41 the asymptotic theorems for the stationary probabilities pi 
and P2 have been established. Section |4] is devoted to asymptotic analysis of the 
stationary probabilities qL-i, i — 1,2,.... In Section T4.1[ the explicit represen- 
tation for the stationary probabilities qi is derived. On the basis of this explicit 
representation and Tauberian theorems, in following Sections 14. 21 14.31 and 14.41 as- 
ymptotic theorems for these stationary probabilities are established in the cases 
pi = 1, pi = 1 + 5 and p\ = 1 — 5 correspondingly, where positive 5 is assumed 
to vanish such that 5L — > C as L — > oo. In Section [5] the objective function given 
in (|1.2[) is studied. In following Sections 15.11 15.21 and 15.31 the asymptotic theorems 
for this objective function are established for the cases pi = 1, p% = 1 + § and 
p\ = 1 — 5 correspondingly. In Section [6l the theorem on existence and uniqueness 
of a solution is proved. In Section the case of linear costs is studied and relevant 
numerical results are provided. 



6 



VYACHESLAV M. ABRAMOV 



2. Methodology of analysis 

In this section we describe the methodology used in the present paper. This 
is a very important step because the earlier methods of [5] do not work for this 
extended model and hence need in substantial revision. 

We start from the model where arrivals are Poisson, and then we explain how the 
methods should be developed for the model where an arrival process is compound 
Poisson. 

2.1. State dependent queueing system with Poisson input and its char- 
acteristics. In this section we consider the simplest model in which arrival flow is 
Poisson with parameter A. Let Tl denote the length of a busy period of this sys- 
tem, and let t9~ , denote the cumulative times spent for service of customers 
arrived during that busy period with probability distribution functions B\ (x) and 
B2(x) correspondingly. For k = 1,2, the expectations of service times will be de- 
noted by — = J °° xdBk(x), and the loads by pk = Let vl, v£ and vf^ 
denote correspondingly the number of served customers during a busy period, and 
the numbers of those customers served by the probability distribution functions 
B\(x) and B2(x). The random variable coincides in distribution with a busy 
period of the M/GI j\j L queueing system (L is the number of waiting places ex- 
cluding the place for server). The elementary explanation of this fact is based on a 
property of level crossings and the property of the lack of memory of exponential 
distribution (e.g. [5]), so the analytic representation for ET^ is the same as this 
for the expected busy period of the M/GI /I/ L queueing system. The recurrence 
relation for the Laplace-Stieltjes transform and consequently that for the expected 
busy period of the M/GI/l/L queueing system has been derived by Tomko [T8] , 
So, for ET^ 1 "* the following recurrence relation is satisfied: 

(2.1) ET« = £ ET« l+1 r e-^M^), 

where ETq 1 ' = — . (The random variable T^ 1 ' is defined similarly to that of . 
The only difference is in the state parameter i that is given instead of L.) Recurrence 
relation (12.11) is a particular form of the recurrence relation 

n 

(2.2) Q n — Qn—i+lfii 

oo 

where Q ¥= 0, /o > 0, /, > 0, i = 1, 2, . . . and £ j l = 1 (see Takacs [T7]). 

i=0 

Using the obvious system of equations: 

(2.3) ET L = ETP + ETP, 

(2.4) Ev L = Ei/^+Ei/f, 
and Wald's equations (see [5], p. 384) 

(2.5) ET? = ±E4\ 

Mi 

(2.6) ET} 2) = — Ev ( l\ 

M2 
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one can express the quantities ET^, Evl, ET^\ Ei/^ and Eu^ all via ET^p as 
the linear functions. Indeed, taking into account that the number of arrivals during 
a busy cycle coincides with the total number of customers served during a busy 
period we have 

(2.7) AETl + 1 = E^l, 

which together with (|2.3j) - (|2.6|) yields the linear representations required. 
For example, 

(2.8) E,f = - J- - -L ■ ^ET«, 



92 Mi 1-/02 



and 



(2.9) ETf = , P2 , - % ■ 1 —^ET£ ) 

A(l-p 2 ) A l-p 2 1 



As a result, the stationary probabilities p\ and p 2 both are expressed via Evjp as 
follows: 

Pi 



1-/92 



P2 + P2{P1 - 1)E4 X) 

P 2 = 7u~ 

i + ( Pi - P2 )e4 1) 

(see Section 2 of [2] for further details). It is interesting to note that the coefficients 
in linear representation all are insensitive to the probability distribution functions 
B\(x) and B 2 (x) and are only expressed via parameters such as fix, \i 2 and A. 

The asymptotic behaviour of ET^ as L — > oo that given by (|2.1j) is established 
on the basis of the known asymptotic behaviour of the sequence Q n as n — > oo 
that given by (|2.2p (see [T7], p. 22, [S] as well as recent paper [3]). To make the 
paper self-contained, the necessary results about the asymptotic behaviour of Q n 
as ri — > cxd are given in Section 13.11 



2.2. State dependent queueing system with compound Poisson input and 
its characteristics. For M x /GI/l/L queues, certain characteristics associated 
with busy periods have been studied by Rosenlund |11) . Developing the results 
of Tomko [18], Rosenlund [11] has derived the recurrence relations for the joint 
Laplace-Stieltjes and z-transform of two-dimensional distributions of a generalized 
busy period and the number of customers served during that period. In turn, both 
of these approaches [18] and [H] are based on a well-known Takacs' method (see 
[IS] or [TB]). 

For further analysis, [11] used matrix-analytic techniques and techniques of the 
theory of analytic functions. This type of analysis is very hard and seems cannot be 
easily adapted for the purposes of the present paper, where a more general model 
than that from a paper [11] is studied. 

In this section we explain how the method of Section 12.11 can be extended, and 
how the characteristics of the system can be expressed via the similar convolution 
type recurrence relations. 

Notice first, that the linear representations similar to those derived for the state 
dependent queueing system with ordinary Poisson input are satisfied for the present 
system as well. Indeed, equations (|2.3|) - ()2.6[) all hold in the case of the present 
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queueing system. The only difference is that instead ol (|2.7|) . the relation between 
ETl and Evl should be 

(2.10) AE<tETl + E<r = Evl, 

where c; denotes a batch size of an arrival. (The random variable <; has the distri- 
bution Pr{c; = i} = rj.) This leads to a slight change of the linear representations 
mentioned in Section [2. II The main difficulty, however, is that the recurrence rela- 



tion for ET^ (or the corresponding quantity Ev^) is no longer a convolution type 
recurrence relation as (|2.2p . So, we should use another type of analysis, which is 
explained below. 

For this model, let Tj, j = 1, 2, . . . ,L, denote the time interval starting from the 
moment when there are L — j + 1 customers in the system until the moment when 
there remain L — j customers for the first time since its beginning. Similarly to 
the notation used in Section |2~TI let us introduce the random variables Tj , Tj , 
Vj, v?\ j = 1, 2, . . . ,L, which have the same meaning as before. Specifically, 

when j takes the value L, Tl is the length a busy period starting from a single 
customer (1-busy period); is the number of customers that served during a 
1-busy period, and so on. 

With the aid of the aforementioned Takacs' method |T5] , [TB], one can derive the 
recurrence relation similar to that of (|2.1[) . Namely, 

(2.11) ET«=^E^ +1 m(x), 



i=0 



z=0 



where ETq = and the generating function f x (z) is given by (jl.ip . So, the only 
difference between (|2.1I) and (|2.11[) is in their integrands, and in particular case 
7"i = 1, r*j = 0, i > 2 we clearly arrive at the same expressions. The explicit results 
associated with recurrence relation (|2.11l) is given later in the paper. Apparently, 
the similar system of equations as (|2.1I) - (|2.6p is satisfied for the characteristics of 
the state dependent queueing system M x /GI /l. Namely, 

(2.12) ET L = ETP + E?P, 

(2.13) EV L = EV { l ] + EV^\ 

(2.14) Ef} 1 ) = J-E^), 

Mi 

(2.15) Ef} 2) = — E?[ 2) . 

Therefore, the same linear representations via ET^ hold for characteristics of these 
systems, where by p\ and pi one now should mean the expected numbers of ar- 
rived customers per service time (not the expected number of arrivals) having the 
probability distribution function B\ (x) and, respectively, B2 (x) . 

Let us now consider the length of a busy period Tl and associated random 
variables T^\ T L 2 \ vl 1 v^ 1 and . Let ft denote a size of batch that starts a 
busy period. (An integer random variable ft has the distribution Pr{<j = i} = rj.) 
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Then Tl can be represented 

?lA(L + l) fi-(i+l) 

(2.16) T L = ^ TL-i+i+ To,*, 

i=l i=l 

where 1-busy periods Tj,_j-)_i, i = 1, 2, . . . , L are mutually independent; 

To denotes a special 1-busy period that starts from a service time having the 
probability distribution function B\(x) and all other service times are mutually 
independent and identically distributed random variables having the probability 
distribution B2(x), and the distributions of intcrarrival times and batch sizes are 
the same as in the original state dependent queueing system; 

To,i, i = 1, 2, . . ., is a sequence of independent and identically distributed 1- 
busy periods of the M x /G/l queueing system, the service times of which all are 
independent and identically distributed random variables having the probability 
distribution function B 2 (:e), and the distributions of interarrival times and batch 
sizes are the same as in the original state dependent queueing system; 

a A b denotes min{a, &}; 

= denotes the equality in distribution; 

in the case where q\ — (L + 1) < 0, the empty sum in (|2.16j) is assumed to be 
zero. 

In turn, the representation for is as follows: 

?1 A(L+1) 

(2-17) tP± £ r« t+1 , 

where denotes a single service time having the probability distribution func- 
tion B\(x). Whereas ET^ is determined by recurrence relation (12 . lip , which is a 
particular case of (12.21) , a convolution type recurrence relation is no longer valid for 

etP. 

For the following asymptotic analysis of ET^ 1 and other mean characteristics 
such as Ei/^ , Evf^ we will use the following techniques. We first study the mean 
characteristics EE{T L |<n A L}, EE^ 1 ^ A L}, EE{Tj? A L}, EE^ki A L} 

(2) 

and EE{^ ; |<ri A L}. Then, assuming that L — > oo, we have lim Pr{^i A L = 

L— toe 

i} = Pr{<ri = i}, as well as lim EE{Tl|<ti A L} = lim ETl, and the similar limits 

L — > oo L — > oo 

hold for the other mean characteristics. The following asymptotic behaviour of the 
probabilities pi and P2 as L — > oo is then established similarly to that in [2] . 

Let us show the justice of the linear representations that similar to those (|2.8j) 
and flU}. Write ET L = a + bET^\ where a and b are specified constants. Then, 
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by the total probability formula, 

Z i 

EE{T L | ft A L} = Pr{?i AL = i}^ ET L - j+ i 

»=i j=i 

= £Pr{ fl AL = o£(a + &Ef« i+1 ) 
(2.18) ^ 

L L i 

= aj^ «Pr{?i AL = i} + bY, Pr{<Ti Ai = i}^ Ef/ X) 



Z-i+1 

3=1 



= aE(a AL)+6EE{rP| ft AL}. 



z 

This representation is quazi-linear in the sense that only for J > L (but not for all 
J > 1) 

EE{Tj| ?1 AL} = aE( ft A L) + 6EE{Tj x) | fl A L}. 
Apparently, the similar quazi-linear representations are satisfied for the mean char- 
acteristics EE{i/ L |?iA£}, EE{t£ 2) |<tiA£}, and EE{i/^|?i AL} all via EE{T^|ftA£}. 
The exact values of the coefficients in these quazi-linear representations will be de- 
rived in the next sections. 

3. Asymptotic theorems for the stationary probabilities pi and p 2 

In this section, the explicit expressions are derived for the stationary probabil- 
ities, and their asymptotic behavior is studied. These results will be used in our 
further findings of the optimal solution. 

3.1. Preliminaries. In this section we recall the main properties of recurrence 
relation (|2.2I) . The detailed theory of these recurrence relations can be found in 

oo 

Takacs [T7]. For the generating function Q(z) = Qj z K \ z \ < 1 we have 

3=0 

(3-D ^) = #V^ 

b \z) — z 

oo 

where F(z) — J2 fj zJ - 

3=0 

Asymptotic behavior of Q n as n — > oo has been studied by Takacs |17j and 
Postnikov [9\. Recall the theorems that are needed in this paper. 
Denote 7 m = lim^i d d fi 2) . 

Lemma 3.1. (Takacs UTTJ] , p. 22-23). If 71 < 1 then 
(3.2) lim Q n = 



1 - 71 

If 71 = 1 and 72 < 00, then 

Qn 2Qo 

lim = . 

n— >oo n 72 

If 7i > lj then 

Qo 



(3 - 3) &o[ Q »-*»[l-F'{*)]J 1-71' 

where d is the least in absolute value root of the functional equation z — F(z). 
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Lemma 3.2. (Postnikov HJ , Sect. 25) . Let 71 = 1, 72 < 00 and /o + /1 < 1. 

Then, as n — > oo. 

(3.4) Qn+1-Qn= — +0(1). 

72 

3.2. Exact formulae for pi and p2- In this section we derive exact representa- 
tions for pi and P2 via Ei/j*' . We also obtain some preliminary asymptotic represen- 
tations that easily follow from the explicit results. Those asymptotic representations 
will be used in the sequel. 

We first start from the linear representations for in terms Ei/^ . Namely, 

we have the following lemma. 

Lemma 3.3. For Ez/£ ', L = 1,2,..., we have the following representation 

(3.5) E ^) = 1 _1^1 E ^ 

t — 92 t — 92 
where p\ — arte? P2 = < 1, Old ES^ is given by 

(3.6) E4" = E*,r5^J B 'W' 



2 = 



(1) 



Proof. Taking into account that the number of arrivals during 1-busy cycle (1-busy 
period plus idle period) coincides with the number of customers served during the 
same 1-busy period, according to Wald's identity we have: 

A (ET L + jj= AE? L + 1 = Ev L = + E^ 2) . 

This equality together with (|2.12l) - (|2.15l) yields the desired statement of the lemma, 
where (|3.6[) in turn follows from (|2.11[) and Wald's identity (I2.14j) . □ 

The next step is to derive representations for EE-fi/^ |?i AL} and EE{z^ 2 ' ) |?i AL}. 
We have the following lemma. 

Lemma 3.4. For EE{^ '\<;i A L} we have 

.COu a tx _ E ^ A L ) _ i_^rr;„(i) 

1 - Pi 1-/92 

where 



(3.7) EE{^V AL} = - T"^ EE K 1J ki A L}, 



EE{u^\ qi AL} = ^ Pr{ ?1 A L = i}£ Ez7« 

i=i j=i 

and Et^^-p J = 1,2, . . ., L, are given by (I3.6|) . 

Proof. Following the same arguments as in (|2.18|) . one can write 

EE{4 2) ki A L} = aE( ft A L) + ftEE^ |?i A L] 

for specified constants a and b for which the linear representation 

is satisfied. Hence, according to relation (|3.5I) of Lemma 13.31 a = ^ and 6 = 

— j^"^ 1 . The proof is completed. □ 
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The following lemma yields exact estimates for the difference Ev^p — EE{v^ ^ A 
L}. 

Lemma 3.5. We have the following estimate: 

(3.8) Evjj? - EE{iy ( L 1) | Cx AL} = Pr{ ?1 > L}, 
Proof. Similarly to (|2.17j) we have 

CiA(i+l) 

ADA V 

i=l 

where i = 1, 2, . . . , L are mutually independent, and Vq = 1. Hence, 

L+l i 

(3.9) E^ 15 = £ Pr{ ft A (L + 1) = £ E#> i+1 . 

i=i j=i 

In turn, the representation for EE{i/^|^i A L} is 

L i 

(3.10) EE{i£>| G A L} = Pr{?i A L = i}^E/W j+1 . 
Subtracting (|3.10p from (|3. 91) we obtain: 

L L 

Ev { p - EE{i/£ x) | ft AL} = Pr{ ?1 = L] £ E^ (1) + Pr{ ft > L} ]T Eif > 

3=1 3=0 
L 

-Pr{ ft >L}^E^ (1) 

3=1 

= Pr{ ?1 > L}. 

Relation (|3.8p is proved. □ 

From Lemma 13.51 we have the following important corollary. 
Corollary 3.6. As L ^ do, 

(3.11) E4 1) -EE{4 1) | ft AL} = o(l), 
and 

(3.12) E4 2) -EE{4 2) k 1 AL} = o(l). 

Proof. Asymptotic relation (|3.11[) follows immediately from (13.81) . In order to show 
(|3.12p let us first derive the linear representation of Evf^ via Ev£ . From relation 
(12.101) and equations (|2.3p - (|2.6l) in Section |2~T1 which also hold true in the case of 
the present queueing system with batch arrivals, we obtain: 

As well, for EE{i/^|?i A L} from Lemma f3T4l we have representation (|3.7j) . Hence, 
comparing the terms of ()3.13p and (|3.7p and taking into account (|3. 1 1(1 we easily 
arrive at asymptotic relation (|3.12|) . Lemma 13.61 is proved. □ 



OPTIMAL CONTROL OF A LARGE DAM 



13 



The following lemma presents the exact formulae for the stationary probabilities 



(1-/0 2 )E? 



Eo+( Pl ~p 2 )E^ y 



Pi and p 2 via the term Evjp. 
Lemma 3.7. We have: 

(3.14) Pl 

and 

(3.15) P2 E, + P2 { Pl -l)E^\ 

Proof. Using renewal arguments (e.g. [T^]) and relation (|2.10l) . we have: 

1 

A Ec 



(3.16) pi 



and 



(3.17) P2 



ET (D + ET (2) + 1 E i£> + E4 2) 



A 



Erf _ p 2 E,j 2 > 

ET (D + ET (2) + 1 E^ + E^f 
A 



Now, substituting p,13|) for the right sides of p,16|) and p,17|) we obtain rela- 
tions (|3. 14[) and (|3.15|l of this lemma. □ 

3.3. Asymptotic theorems for p\ and p 2 under 'usual assumptions'. By 

'usual assumption' we only mean the standard cases as p\ = 1, p\ < 1 or p\ > 1 
for the asymptotic behaviour as L — > oo. In the following sections the heavy load 
assumptions are assumed. 

The main result of Section 13.21 is Lemma 13.71 where the stationary probabilities 
Pi and p 2 are expressed explicitly via Ev^\ The aim of this section is to obtain 
the analogue of asymptotic Theorem 3.1 of [2\. To this end, we will derive an 
asymptotic representation for EE{z^£ L ' ) A L} as L — > oo. 

Let us first study the asymptotic behavior of EiT^ as L — > oo. For this purpose 

00 ~(i) ■ 

derive the representation for the generating function ^2 E^ 7 z 3 . Using represen- 



tation (|3.6p . we have: 



1-0 ' 



(3 18) 3=0 i=° i=0 

U(z) 



U{z) 



where 



(3.19) 



U(z) = J exp j-Az I :i - ^ ) ; / 
= Bi(X-XR(z)). 
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(By -Bi(s) we denote the Laplace-Stieltjes transform of B\(x) (SH(s) > 0), and 

^ oo 

R(z) = r i zl i \ z \ < !■) Hence, from p. 191) and (|3.18[) we obtain: 



(3.20) VE^. . 
^ 3 Si(A-Ai?(z))-z 

Notice, that the right-hand side of p,18[) and hence that of (|3.20p has the same 
form as (|3.ip . Therefore, according to Lemmas 13.11 and 13.21 the asymptotic be- 
haviour of EI^ 1 ', as L — > oo, is given by the following statements. 

Lemma 3.8. If pi < 1, then 

(3.21) hm E?[ 1} = ' 



L->oo 1 - pi 

If pi — 1, and additionally pi 2 — (Xx) 2 dBi(x) < oo and E^ 2 < oo, then 



,,22, E ^_ E5 <.) 1 = _ilL^ + 0(1 , 

If Pi > X, then 



(3.23) lim 

L oc 



tip 



ip L [l + XB[(X — XR((p))R'(ip)] 



I -Pi 



where ip is the root of the functional equation z = B\(X — XR(z)) that is least in 
absolute value. 



Proof. Asymptotic relations (|3.21[) and (|3.23[) follow by application of those (13. 2[) 
and, respectively, p. 31) of Lemma 13. II 

In order to prove asymptotic relation p.22[) we should apply the Tauberian 
theorem of Postnikov (Lemma 13. 2j) . Then asymptotic relation p.22j) is to follow 
from p.4p if we prove that the Tauberian condition /o + f\ < 1 of Lemma 13.21 is 
satisfied. In the case of the present model, we must prove that for some Ao > the 
equality 

/>oo 

\ X I 



(3.24) / c- AoX (l + Aor x a;)dBi(x) = 1 

Jo 

is not the case. Without loss of generality r\ in p.24p can be set to be equal to 1, 
since 

/•OO poo 

I e - Ao:E (l + A r 1 x)dBi(a;) < / C - Xox {l + X x)dB 1 (x). 
Jo Jo 
Thus, we should prove the inequality 

/•OO 

/ e- Ax (l + Aa;)dBi(a;) < 1. 
Jo 

Indeed, J °° e~ Xx (l + Xx)dBi(x) is an analytic function in A, and hence, according 
to the theorem on the maximum module of an analytic function, equality p.24[) 
where r% = 1 must hold for all Xq > 0. This means that p. 241) is valid if and only 
if 



Jo i! 



OPTIMAL CONTROL OF A LARGE DAM 



15 



for all i > 2 and Ao > 0. Since / °° e Xx (— x) l ABi{x) is the ith derivative of the 
Laplace-Stieltjes transform _Bi(A), then in this case the Laplace-Stieltjes transform 
Si (A) must be a linear function in A, i.e. -E>i(A) = e?o + <^iA, do and d\ are some 
constants. However, since |£?i(A)| < 1, we have do = 1 and d\ = 0. This is a trivial 
case where Bi(x) is concentrated in point 0, and therefore it is not a probability 
distribution function having a positive mean. Thus (|3.24|) is not the case, and the 
aforementioned Tauberian conditions are satisfied. 

Now, the final part of the proof of (|3.22p reduces to an elementary algebraic 
calculations: 

72 := ^Bi(A - XR(z))\ z=1 = - 1 + pi j2 (E?) 2 . 
az z E<; 

The lemma is proved. □ 



With the aid of Lemma 13.81 one can easily obtain the statements on asymptotic 
behavior of Ez/^ , EE{f£ |<j A L} and, consequently, p\ andp2- The theorem below 
characterizes asymptotic behavior of the probabilities p\ and P2 as L — > oo. 

Theorem 3.9. If pi < 1, then 

(3.25) lim Pl (L) = 1- Pl> 

L— >oo 

(3.26) lim p 2 (L) = 0. 

If pi = 1, and additionally pi^ = J °° (Xx) 2 dBi(x) < oo and Ec 2 < oo, then 

/oo^ ,• r (t\ Pi,2(EQ 3 + Ec 2 - E<^ 

(3.27) lim L Pl (L) = — , 

L— too 

riiQ\ r t /t\ P 2 Pi,2(E<;) 3 + E<r 2 - E^ 

(3.28) lim Lp 2 {L) = — . 

L->oo 1 — pi Zhq 

If Pi > I, then 

(3 29) lim ^B. = (1 - P2)[l + \B[(X - \R(<p))B? (<p)](l - ^)Ec 
L^oo tpL ( Pl - p 2 )[l - R(tp)} 

(3.30) limp 2 (L) = P2(P1 ~ 1) , 

L^oo Pl - p 2 

where <p is defined in the formulation of Lemma \3.8[ 

Proof. Let us first find asymptotic representation for EE{i/£ |fr A L} as L — > oo. 
According to Lemma l3~8l and explicit representation (|3.10p we obtain as follows. 
If pi < 1, then 

lim EE{4 1) kiAL} = lim ViPrkiA£ = 

(3.31) l-Pi^U 

= E<? 

1 - Pi ' 
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If pi = 1, pi,2 < oo and Ec 2 < oo, then 

EE{4 X) kiAi} 2E ? 



(3.32) 



lim 

L— foo 



Pi, 2 (Ec) 3 + Ec 2 - l 

2(EQ 2 
p 1)2 (E ? ) 3 + E<r 2 -E^ 



lim iPrUi A L = i} 

,-inn — ' 



If pi > 1, then 



lim 

L— ¥oo 



EE^IaAL} 



1 



(3.33) 



l + \B[{\- \R(<p))R>((p) 

L i-1 

x lim Pr{<ri A L — i\ tpj 

i=l j=0 
1 

[l + ABi(A-A%))5'M](l-^) 

L 

x lim V Pr-ki AL = i}(l - co*) 

L— >oo * — ' 

8=1 

[1 + XB[(\ - XR(ip))R'(ip)](l - ip) ' 



Therefore, taking into account these limiting relations p.31j) . (|3.32|) and ()3.33p 
by virtue of (|3.1ip (Corollary I3.6f) and explicit representations (|3.14j) and (|3.15p 
(Lemma 13. 7p for p\ and P2, we finally arrive at the statements of the theorem. The 
theorem is proved. □ 

3.4. Asymptotic theorems for pi and p2 under special heavy load condi- 
tions. In this section we establish asymptotic theorems for p\ and pi under heavy 
load assumptions where (i) p\ = 1 + 5 or (ii) p\ = 1 — 8, and S is a vanishing positive 
parameter as L — > oo. The theorems presented in this section are analogues of the 
theorems of [5] given in Section 4 of that paper. The conditions are special, because 
these heavy load conditions include the change of the parameter p\ as L increases 
to infinity and 8 vanishes, but the other load parameter p2 remains unchanged. 

In case (i) we have the following two theorems. 

Theorem 3.10. Assume that pi = 1 + 8, 8 > and that L8^C>0asS^0 
and L — > oo. Assume that pi^(L) is a bounded sequence, assume that E<; 3 < oo 
and that the limit lim p\^{L) — p\,2 exists. Then, 

L— >oo 



(3.34) 



(3.35) 



Pi 



1>2 



exp 



2C*Ec 



Pi, 2 (E^) 3 
8pi exp 



Ec 2 - E? 
2CEc 



p 1:2 (E0 3 + E^ 2 -Ec 



(1-P2) 



exp 



2CE<; 



Ai,2 (E?) 3 + E<r 2 — E? 



- 1 
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Proof. Note first, that under assumptions of the theorem there is the following 
expansion for ip: 

(3.36) v = l- = 2 + 0(,S 2 ). 

This expansion is similar to that given originally in the book of Subhankulov [13] , 
p. 362, and its proof is provided as follows. Write the equation tp = B\(\ — \R(ip)) 
and expand the right-hand side by Taylor's formula taking ip = 1 — z, where z is 
small enough, when 8 is small. We obtain: 

Disregarding the small term 0(z 3 ) in f|3.37p we arrive at the quadratic equation 

(M8 , fe -M!i£±(L±j)(!£!^)^ = o. 



The positive solution of (|3.38[) . 

2SE<, 



/ ? 1 , 2 (Ec)3 + (l + <5)(E ? 2-E C ) ! 

leads to the expansion given by (|3.36|) . 

Let us now expand the right-hand side of (|3.33j) when 6 is small. For the term 
1 + A_B^(A — XR(ip)) R' ((p) we have the expansion 

(3.39) 1 + XB[(X - \R(<p))R'((p) = S + 0{6 2 ), 
Then, according to the l'Hospitale rule 

r 1 - f 
lim = be;. 

u-fl 1 — U 

Hence 

(3.40) i-?M = E,[l + (l)]. 

1 - ip 

Substituting (|3.36[) . (|3.39[) and (|3.40[) into (|3.33[) we obtain the expansion 

ex p ( - 2C£q \ - 1 

(3.41) EE{,W k A L} = ^KM*)* + ^ + ^ 

Hence, relations (I3.34[) and (|3.35p of the theorem follow by virtue of p. Ill) (Corol- 
lary I3.6[) and explicit representations (|3.14j) and (|3.15[) (Lemma 13.71) for pi and 
Pa« ' □ 

Theorem 3.11. Under the conditions of Theorem \3.10\ assume that C = 0. Then, 

(1AO\ V T (T\ Pl,2(EQ 3 + E^ 2 - E<^ 

(3.42) hm L Pl (L) = — , 

P2 Pi, 2 (E<;) 3 + E<r 2 - E<r 



(3.43) lim Lp 2 (L) = 

i^oo 1 — p 2 zhq 

Proof. The statement of the theorem follows by expanding the main terms of as- 
ymptotic relations p.34j) and (|3.35p for small C. □ 

In case (ii) we have the following two theorems. 
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Theorem 3.12. Assume that pi = 1 — 6, S > and that L5—>C>0as5—>0 
and L — > oo. Assume that p\^(L) is a bounded function, assume that Ec 3 < oo and 
that the limit lim pi^(L) — p\^ exists. Then, 

L — > oo ' 



(3.44) 



(3.45) 



Pi 



P2 



6 exp 

&P2 



fr^Ec) 3 + E<r 2 - E C 



exp 



2CEq 
Pi, 2 (Ec) 3 + E^ 2 - E^ 
2CE? 



- 1 



1 - Pi 



[l + o(l)]. 



Proof. The explicit representation for the generating function for is given by 

(|3.20[) . Since the sequence {Et'j 1 ' 1 } is increasing, then the asymptotic behavior of 

Et^ as L — > oo under the assumptions p\ = 1 — S, LS — > C as L — > oo can be found 
according to a Tauberian theorem of Hardy and Littlewood (see e.g. [9] , [T3] , [2] , 
[20] . and [17], p. 203). Namely, according to that theorem, the behaviour of Ev^ 
as L —> oo and S — > such that SL — > C > can be found from the asymptotic 
expansion of 



(3.46) 



(1-z)- 



5i(A- Ai?(z)) 



Bi(A - XR(z)) - z 

as z t 1. Similarly to the evaluation given in the proof of Theorem 4.3 [2J, we have: 
B x (X-\R{z)) 



l-z 



Bx(\-\R(z))-z 



l-z 



1- Z - P1 (1- Z )+ P i £(!i)_+Ei__! i(1 _ z)2 + _ z)3) 



2E<; 



1 



(3.47) 



1 



/ME^ + E^-E^ ' 

1 + 271^ 

1 



(S exp 



Px, 2 (Ec) 3 + E^-Ec 
2JE<j 



(l-z) 



+ 0((l-z) 2 ) 
[l + o(l)]. 



Therefore, assuming that z = — > 1 as L — > oo, from (I3.47[) we arrive at the 
following estimate: 



(3.48) 



Ev 



(i) 



iexp 



Pl.,2^) 



2CEq 



[1 + 0(1)]. 



Comparing (|3.23j) with (|3 . 33|) and taking into account p.40|) . which holds true 
in the case of this theorem as well, we obtain: 



(3.49) 



ccr a n E ^ ( Pi,2(E<) 3 + Ec 2 - E<; 
EE{,[ \i AL}= T exp ( _ 



[l + o(l)]. 
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Hence, relations (|3.44p and (|3.45|) of the theorem follow by virtue of (I3.11|) (Corol- 
lary I3.6j) and explicit representations (|3.14j) and ()3.15p (Lemma 13. 7|) for p\ and 
Pa- □ 

Theorem 3.13. Under the conditions of Theorem \3.1S\ assume that C = 0. Then 
we have (f3~42|) and ([3~43]) . 

Proof. The proof of the theorem follows by expanding the main terms of the as- 
ymptotic relations p.44|) and (|3.45|) for small C . □ 



4. Asymptotic theorems for the stationary probabilities q t 

The aim of this section is asymptotic analysis of the stationary probabilities qi, 
i = 1, 2, . . . , L as L — > oo. The challenge is to first obtain the explicit representation 
for qi in terms of Ei/^, and then to study the asymptotic behavior of qi as L — > oo 
on the basis of the known asymptotic results for Ev^ as L — > oo. The asymptotic 
results are obtained in the following three cases: p\ = 1, pi = 1 +5 and p\ = 1 — 6, 
where 5 is a positive small value. 



4.1. Explicit representation for the stationary probabilities The aim of 

this section is to prove the following statement. 

Lemma 4.1. For i = 1, 2, . . . , L we have 

(4-1) qi =p lPl (E^-Eu^\). 

Proof. Using renewal arguments (e.g. [12]), relation (|2.10[) and Wald's identities: 



we have: 



ET W ET (D E (D _ E (i) 

(4.2) g 4 = ^ *=l =pi ->— £±i = l,2,. 

ET L + | L 
A 

Taking into account that and then applying the linear repre- 

sentation for Ev L given by (|3.13j) , from (|4.2j) we obtain: 

_ pi(l-p 2 ) / E (i) _ E (i) \ • _ i o r 
E^+(pi -p 2 )E4 1) v y 

Hence, representation (|4.ip follows from p. 141) (Lemma 13. 7[) , and Lemma 14.11 is 
proved. □ 

4.2. Asymptotic analysis of the stationary probabilities The case = 

1. Let us study asymptotic behavior of the stationary probabilities q t . We start 
from the following modified version of (|3.22[) (Lemma [ 
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which is assumed to be satisfied under the conditions pi j2 < oo and E<^ 2 < oo. 
Under the same conditions, similarly to ()3.32[) we obtain: 

EE{4 1 2.| ?1 A L} EE{A_ X | Q AL} = - — 



I 



(4.4) x ^iPr{ft A£ =i} + o(l) 



i=l 



2(E?) 



2 



0(1). 



Pi >2 (E0 3 + E^ 2 - E? 
Hence, according to p. lip (Corollary I3.6[l and (|4.4[) we have the estimate 

<"» E ^- E ^- %, 2 (E^-E t + °«"- 

Asymptotic relations (I4.5p . (|3.27[) together with explicit relation (I4.1[) of Lemma 
14.11 leads to the following theorem. 

Theorem 4.2. In the case pi = 1 under the additional conditions pi j2 < oo and 
Ei; 2 < oo /or any j > we have 

(4.6) lim LqL-j = 1. 

Note, that the asymptotic relation given by (14.61) is not expressed via E^ and, 
therefore, it is invariant and hence the same as for the queueing system with ordi- 
nary Poisson arrivals. 

4.3. Asymptotic analysis of the stationary probabilities The case pi = 

1 + 6, 6 > 0. In the case p\ = 1 + 6, 6 > the asymptotic behaviour of is specified 
by the following theorem. 

Theorem 4.3. Assume that pi = 1 + 6, 6 > 0, and L6^C>0as6—>0 and 
L — > oo. Assume that pi^(L) is a bounded sequence, assume that Ec; 3 < oo and 
there exists joi )2 = lim pi^L). Then, for any j > 

L— >OG 



exp 
QL-j = — 



2CE^ 



p lj2 (E0 3 + E^ 2 -E^ 



(4.7) exp 



2CEo 



Ji, 2 (E?) 3 + E? 2 - E^ 

/ 26E<; V 26Eo 

X ^ pi, 2 (E^) 3 + E<; 2 - Ej pi, 2 (E?) 3 + E^ 2 — Ff J - 

Proof. Expanding (|3.23p for large L, we have 



(4-8) E#> = , + - J- + o(l). 

L J (^ L [l + XB'^X — \R((p))R'(<p)] 1 -pi 

In turn, from (|4.8p for large L we obtain: 

(4.9) EP« - Ei£> 1 = J 1 = ^ + o(l). 

V [1 + ^B[(X - \R(<p))R'(cp)] 
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From flU]), similarly to (pT33]) . we further have: 

EE^IciAil-EE^.JftAi} 

(i-%))(i- y y 

[l + AB;(A-A%))i?'(^)](l-^) 
and, according to p. lip (Corollary 13. 6[) . 



(4.io) &£> , - e,w, , = — a-^j)d^v o(1) 

[l + ABi(A-A7i( V ))J2'( V )](l- V ) 

Next, under the conditions of the theorem, asymptotic expansions ()3.36j) (|3.39j) 
and (|3.40p hold. Taking into consideration these expansions we arrive at the fol- 
lowing asymptotic relations for j = 0, 1, . . .: 



C (1) IT (!) 

E »L-j - Eu L-j-l = ex P 



2CE<r 



pi, 2 (E0 3 + E?a - E? 



X 1 ~ r ^-xa , ~ 7F3a , E- [l + °(l)l' 



pi, 2 (E0 3 + E^ 2 - E^y pi, 2 (E?) 3 + ^ 2 - E<r 

Now, taking into account asymptotic relation (|3.34p of Theorem 13.101 and the ex- 
plicit formula given by (I4.ip (Lemma 14- If) we arrive at the statement of the theo- 
rem. □ 

4.4. Asymptotic analysis of the stationary probabilities q^. The case p\ = 

1 — <5, 5 > 0. In the case px = 1 — 6, S > 0, the study is more delicate and based 
on special analysis. The additional assumption of this case is that the class of 
probability distribution functions {B\(x)} and Pr{<; = i} are given such that there 
exists a unique root r > 1 of the equation 

(4.11) z = B 1 (X-XR{z)), 

and there exists the first derivative B[(X — Ai?(r)). 

Under the assumption that p\ < 1 the unique root of (|4.11[) is not necessar- 
ily exists. Such type of condition has been considered by Willmot 21 to obtain 
the asymptotic behavior for high queue-level probabilities in stationary M/GI/1 
queues. Denote the stationary probabilities in the M/GI/1 queueing system by 
qi[M/GI/l], i = 0, 1, It was shown in I^T] that 

(4.12) qi [M/GI/l] = -^"^Im" 7 ? J 1 + °W] as i -> °°> 

r*[l + ABi(A-Ar)] 

where -Bi(s) denotes the Laplace-Stieltjes transform of the service time distribution 
in the M/G/l queueing system, and r denotes a root of the equation z = B±(X — Xz) 
greater than 1, which is assumed to be unique. On the other hand, according to 
the Pollaczek-Khintchine formula (e.g. Takacs [TB], p. 242), g,[M/G//l] can be 
represented explicitly 



(4.13) qAM/GI/1] = (1 - Pl ) (E^ (1) - Ev£\) ,i = 1, 2, . . . , 

where the random variable vf^ 1 in this formula is associated with the number of 
served customers during a busy period of the state dependent M/G/l queueing 
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system, where the value of the system parameter, where the service is changed, is 
i (see Section [2TT]) . Representation (|4.13|) can be easily checked, since in this case 

(i) _ gi(A-Az) 



(4.14) J2 Ev] : ' = 



Bi(A-Az) 



and multiplication of the right-hand side of (|4.14j) by (1 — pi)(l ~ z) leads to the 
well-known Pollaczek-Khintchine formula. Then, from (|4.12|) and (|4. 1 3[1 there is 
the asymptotic proportion for large L and any j > 0: 

El/ (i) _ El/ d) 

(4.15) ^ L ( :r =rni+o(i)}. 

In the case of batch arrivals the results are similar. One can prove that the same 
proportion as (|4. 1 5[) holds in this case as well, where r in the case of batch arrivals 
denotes a unique real root of the equation of (|4.1ip . which is greater than 1. (Recall 
that our convention is an existence of a unique real solution of (|4.11l) greater than 
1.) Indeed, the arguments of |21] are elementary extended for the queueing system 
with batch arrivals. The simplest way to extend these results straightforwardly is 
to consider the stationary queueing system with batch Poisson arrivals, in which 
the first batch in each busy period is equal to 1. Denote this system by M 1 ' /G/l. 
For this specific system, similarly to (|4. 1 2[) we obtain: 

(4.16) qAM^/GI/l] = ( l~ Pl)(1 ~ T) ^ [1 + o(l)l as » -y oo, 

t 1 [1 + XB[(X-XR{t))R'(t)} 

where qi\M 1,x /GI /l], i = 0,1,..., denotes the stationary probabilities in this 
system. Then, taking into account (I3.20j) . similarly to (14. 13)) one can write 

(4.17) qiiM^/GI/l] = (1 - py) (sf> - E£«) , z = 1,2,.... 
From (|4.16|) and (|4.17p we obtain 

E £« -E? (1) 

(4-18) ^ &r =^ + °W- 

From (|4TT5|) and the results of Sections I3T21 and I3~31 (see ([3~2Tj) . ([331]) and (|3~TT|) ') 

we also have the estimate 

which coincides with f|4. 15|) . 

Now we formulate and prove a theorem on asymptotic behavior of the stationary 
probabilities qi in the case p\ = 1 — 5, 5 > 0. The special assumption in this 
theorem is that the class of probability distributions {Bi(x)} is defined according 
to the above convention. More precisely, in the case pi = 1 — 5, 5 > 0, and 
vanishing S as L — > oo this means that there exists eo > (small enough) such that 
for all < e < eo, the above family of probability distribution functions Bi te (x) 
(depending now on the parameter e) satisfies the following properties. Let i?i jC (s) 
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denote the Laplace-Stieltjes transform of Bi. e (x). We assume that any Bi <e (s) is 
an analytic function in a small neighborhood of zero, and 

(4.20) B' l c (s) < oo. 

Property (14.20)) is required for the existence of the probabilities Relation (|4.16[) 
contains the term B[(X — XR(r)), and this term must be finite. In addition, the 
term R'(t) < oo must be finite as well, that is, the additional to (|4.20[) associated 
assumption is that 

(4.21) J R'(l + e)<oo 

for any e of the defined neighborhood. Choice of small parameter e is continuously 
connected with that choice of the parameter 6 (or L) in the theorem below. 

Theorem 4.4. Assume that the class of probability distribution functions {Bi(x)} 
and the probabilities r\, r 2 , ... are defined according to the conventions made and, 
respectively, satisfy (|4.20j) and (|4.21|) . p\ = 1 — 8, 5 > 0, and LS —¥ C > 0, as 
8 — > and L — > oo. Assume that px,3 = Pi,a(L) is a bounded sequence, E<; 3 < oo, 
and there exists pip = lim pip(L). Then, 

L— >oc 

1 

QL-j = — 



exp 



(4.22) VPi,2(E?) 3 + E<r 2 - E<r 



2CE<; 



2SEc / 28Ec 



Pi, 2 (E0 3 + E<r 2 — E<r \ Pi, 2 (E?) 3 + E<r 2 - 
/or any j > 0. 

Proof. Under the assumptions of this theorem let us first derive the following as- 
ymptotic expansion: 

(4.23) r = 1 + = jgi 2 + 0(S 2 ). 

pi. 2 {\ic) A + E<; 2 - E<r 

Asymptotic expansion (|4.23[) is similar to that of (|3.36j) . and its proof is also similar. 
Namely, taking into account that the equation z = £?i(A — XR(z)) has a unique 
solution in the set (1, oo), and this solution approaches 1 as S vanishes. Therefore, 
by the Taylor expansion of this equation around the point z = 1, we have: 

(4.24) 1 + , = 1 + (1 - S) Z + Pi.2(E0 3 + (l -^)(E^-EQ za + ^ 
Disregarding the term 0(z 3 ), from (|4.24[) we arrive at the quadratic equation 

5z MB:)* + Q.-S){**-*) j t _ Q 
2E^ 

and obtain a positive solution 

2<5E? 



p l!2 (E f ) 3 + (l + <5)(E? 2 -E ? )' 

This proves (g^SJ). 

Next, from (|4~19l) . (t4T23|) and explicit formula (|4~T|) we obtain 

("») ^ = ^(' %- 1 , 2( e s) ^-eJ ' 1 + °' 1 ''- 
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Taking into consideration 

L-l 



£ 1 



3=0 



26E<; 



p li2 (E0 3 + E^ 2 - 



p 1;2 (EQ 3 + E^-Ec 
26 E<; 

p li2 (EQ 3 + E^ 2 - E^ 
26 E<; 



26E<; 



exp 



p lj2 (E0 3 + E^ 2 -E^ 

2CEs 
p li2 (E0 3 + E^ 2 -E^ 



from the normalization condition p\ +p 2 + ^2 Qi — 1 an d the fact that both pi and 

i=l 

p 2 have the order 0(6), we obtain: 

26E<; 1 



(4.26) 9i 



fc >2 (E?) 3 + E? - E? 



exp 



2CE? 



v pi, 2 (E f ) 3 + E? 2 - E? 
The desired statement of the theorem follows from (|4.26[) . 



[1 + 0(1)]. 



□ 



5. Objective function 
5.1. The case p\ = 1. In this section we prove the following result. 

Proposition 5.1. In the case p\ = 1, under the additional conditions p\p < oo 
and E<; 2 < oo we have: 

(rU r T(n . Pl , 2 (EQ 3 + E^-E^ , P2 Pl , 2 (E^) 3 + Ec 2 -E^ . 

(5.1 hmJ(L)=ji — +j2- — + c , 

L->-oo 2E<; 1 — p 2 2E<; 

1 L 

c* = lim — y a. 

L^oo L ^— ' 

1=1 

Proof. The first two terms in the right-hand side of (15.11) follow from asymptotic 
relations (1X27)) and (f3T28l) (Theorem l3Jl) . The last term c* of the right-hand side 
of (|5.ip follows from (|4.6j) (Theorem 14. 2|) . since 

l ^ L 

lim > QiCi — lim — > c< = c*. 



i=l i=l 



□ 



5.2. The case p = 1 + 5, 5 > 0. In the case p = 1 + (5, 5 > we have the following 
statement. 
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Proposition 5.2. Under the assumptions of Theorem ^. 3\ denote the objective func- 
tion J by j u PP er . We have the following representation: 



(5.2) 



J" 



= C 



3i- 



exp 



P!, 2 (E f ) 3 + E? 2 - E? 



p 2 exp 



-J2- 



2CE<; 



j? 1)2 (E<r) 3 + Ec 2 -E? 



(1 - p 2 ) exp 



2CE? 



Pi l2 (Ec) 3 + E^ 2 - E^ 



„uppcr 



where 



(5.3) 



2CE<; 



exp 



2CE<j 



p li2 (E0 3 + E^ 2 -E^ 



p^ 2 (E0 3 + E^ 2 -E^ 



exp 



2CE<j 



p li2 (E0 3 + E^-E^ 
2CE? 



X & L Cl V~ Jj^(E,r + E? 2 - E f )L 



L-l 



and Cl(z) — ^2 CL-jZ 3 is a backward generating cost function. 
Proof. The representation for the term 



C 



1 



3i- 



exp 



2CE^ 



p li2 (E0 3 + E^ 2 - E^ 

2CE<r 



- 1 



Pi exp 



+32- 



piM^) 3 + E^ - E^ 



(1 - p 2 ) exp 



2C*E^ 



k fr, 2 (E?) 3 + E? 2 - E?, 

of the right-hand side of JO} follows from (f3T34l) and (f3~35|) (Theorem [3TT0]). This 
term is similar to that (5.2) in 2 ]. The new term which takes into account the 
water costs is c uppor . Taking into account representation (|4.7p . for this term we 
obtain: 



L-l 



lim > 



QL-jCL-j 



3=0 
L-l 



exp 



lim c L _, • 

j=o exp 



2C*E(r 



Pl,2(E?) 



2CE<; 



x 1- 



p li2 (E0 3 + E^ 2 -E^ 
2<5LE<r V 2<5iEcr 



(P!, 2 (E0 3 + E^ 2 - Es)Lj (pi, 2 (E ? ) 3 + E^ - E^L* 
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and, because of lim SL — C, representation (|5.3|) follows. 



□ 



5.3. The case p = 1 — S, S > 0. In the case p = 1 — 5, S > we have the following 
statement. 

Proposition 5.3. Under the assumptions of Theorem \4--4\ denote the objective func- 
tion J by j lowcr . We have the following representation 

lower _ ^ L- ( Pl,2(E0 3 + E^ 2 - 



■J 



(5.4) 



where 



(5.5) 



C 

+32 



+ c 



jiexp 

1 - P2 
lower 



exp 



2CE? 
Pi, 2 (EQ 3 + E^ 2 
2CE? 



2CE^ 



1 



p li2 (E0 3 + E<; 2 -E ? 



x lim — Cl 



exp 



2CE<; 



Pi, 2 (E0 3 
2CE? 



E^ 2 - E^ 



- 1 



(pi, 2 (E0 3 + E<r 2 - E?)£ 



L-l 



and Cl(z) — CL-jZ 3 is a backward generating cost function. 



Proof. The representation for the term 



C 



Jiexp 



pi, 2 (EQ 3 + E^ 2 -Ec 
2CE<j 



J2" 



exp 



P!, 2 (E^) 3 + E^ 2 - Ec 
2CE<j 



1 



1 - 92 

of the right-hand side of (O follows from (|3~34"1) and (pR51 (Theorem GTE2]). This 
term is similar to that (5.3) in The new term, which takes into account the 
water costs, is c lower . Taking into account representation (|4.22[) . for this term we 
obtain: 

L-l 

c lower lim c 

3=0 
L-l 

lim J2 CL -r 

L— too * — ' 



i 



3=0 



exp 



2CE^ 



x 1 + 



ft^E?) 3 + E? 2 - E<; 
25LEc 



- 1 



(pi, 2 (Ec) 3 + E<r 2 - EOV (pi, 2 (E?) 3 + E^ 2 - E?)L' 
and, because of lim SL — C, representation (|5.5|) follows. 

L— s-oo 

6. A SOLUTION TO THE CONTROL PROBLEM AND ITS PROPERTIES 



□ 



In this section we discuss the solution to the control problem and study its 
properties. The functionals J u pp ct and J lower are correspondingly given by (15. 2[) 
and (15.41) , and the last terms in these functionals are correspondingly given by (|5.3[) 
and (|5.5[) . For our further analysis we need in other representations for these last 
terms. 
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Denote 



(6.1) 



and 



(6.2) 



^(C) = lim 

L — >CK 



L-l 

E CL-i ( 1 - 
3=0 



2CEcr 



(p ll2 (E ? ) 3 + E^ - e?)£ 



L-l 

EC 

J=0 



2CE ? 



(?i,a(E0 3 + E? 2 - E?)i 



77(C) = lim 



L-l 

E c L—j ( 1 
J'=0 



2CE<r 



(pi )2 (Ec) 3 + Es 2 - Es)L 



L—too L — l 

E (i 

J=0 



2CE<; 



(?i l2 (E0 3 + Ec 2 - E?)£ 



Since {c^} is a bounded sequence, then the limits of (16. ip and (|6.2[> do exist. 

The relations between c upper and ip(C) and, respectively, between c lowor and 77(C) 
are given in the lemma below. 

Lemma 6.1. We have: 

(6.3) c uppor = V(C), 
and 

(6.4) c lowor = 77(C). 

Proof. From (|6.ip and (|6.2p we correspondingly have the representations: 



L-l 



lim — V" cl-2 ( 1 



(6.5) 



and 



(6.6) 



3=0 



2CEq 



(?i,a(E?) 3 + E^ 2 - E?)i 



2CE^ 



(pi,a(E0 3 + E? 2 -E0iy ' 



L-l 



lim 7- V cl-j ( 1 



3=0 



2CEcr 



(pi, 2 (E ? ) 3 + Eq 2 - Ec)L 



L-l , 

77(C) lim y E 1 

L— >oo L/ * — ' \ 



3=0 



2CEs 



(joi, 2 (E?) 3 + Ec 2 — Eq)L 



The desired results follow by direct transformations of the corresponding right-hand 
sides of dHU) and (|6T5jl . 

Indeed, for the right-hand side of (|6.5p we obtain: 



3.7) 



^) & TEC 1 " 



t^(C) 



1 — exp 



2CE<; 



(pi, 2 (E0 3 + E? 2 - E?)L 

2CE<? 

(p 1 , 2 (E0 3 + E^_E0i 



(^(E^ + E^-EQL 
2CE ? 
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On the other hand, from (|5.3|) we have: 

2CE<r 



„uppcr 



1 — exp 

L-1 

L— >oo L 



Pi,2(E<r) 



3=0 



(pi, 2 (E?) 3 + E^ 2 - E<r)L 



2CE? 

3 



(6.8) 



Hence, from (|6.5|) . (|6.7|) and ()6.8|) we obtain (|6.1j) . The proof of (|6.4j) is completely 
analogous and uses the representations of (|5.5j) and (|6.6j) . □ 



The next lemma establishes the main properties of functions ip(C) and f](C). 

Lemma 6.2. The function rp(C) is a non-increasing function, and its maximum 

is ?/>(0) = c* . The function rj(C) is a non- decreasing function, and its minimum is 

L 

77(0) = c* . (Recall that c* — lim 4- Cj is defined in Provosition \5.1[ ) 

Proof. Let us first prove that ip(0) = c* is a maximum of i/j(C). For this purpose 
we use the following well-known inequality (e.g. Hardy, Littlewood and Polya [7] or 
Marschall and Olkin 8 ). Let {«„} and {b n } be arbitrary sequences, one of them 
is increasing and another decreasing. Then for any finite sum we have 

1 ^11 
(6.9) a n b„ < - ^ n» ^ b n . 

n—1 n—1 n—1 

Applying inequality (|6.9[) to the finite sums of the left-hand side of (|6.5|) and 
passing to the limit as L — »■ 00, we have 

r lv^ A 2CE^ 

A™ L ^ c ^ ^ (p 1)2 (E,) 3 + Ee» - E?)£ 

6.10 < lim -) CL-j lim - ) 1 - — — — — — - 

1 L1 ( 2CE<; V 

Then, comparing (|6 . 5|) with (|6. 10[) enables us to conclude, 

m = c *> vxc), 

i.e. ip(0) = c* is the maximum value of ipiC). 

Prove now, that ip(C) is a not increasing function, i.e. for any nonnegative 
Ci < C we have V(C) < V(Ci)- 

To prove this note, that for small positive 81 and 82 we have (I-81-82) = (l-<5i) 
(I-J2) + 0(6162)- Using this idea, one can prove the monotonicity of ip(C) by the 



OPTIMAL CONTROL OF A LARGE DAM 



29 



replacement 

2CEg 

(?i. 2 (E0 3 + E^ 2 -E0i 

(6.11) =(l ^ 2{C - C ^ 



(P!, 2 (E0 3 + Eg 2 - E<;)LJ V (?i, 2 (E0 3 + E<r 2 - E?)L y 

+ o ( \ c>c 1 



in the above asymptotic relations for large L. Indeed, notice that 

L-l 

L->oo £/ 

J=U - 

2(<7-Ci)E? 



l^V 2dE^ V 

>£5oL-M (p 1 , 2 (E0 3 + E^-E<r)Ly' 



x [ 1 - 



(6.12) 



lim lV 1 



(p li2 (Ec) 3 + E<r 2 -Ec)L 
2CE, 



r^o L y (pi, 2 (E?) 3 + E? 2 - E?)L 



I vYi - 2(c-Ci)Ec y 

^i^l (^(E^ + E^-EOiJ 

Therefore, for any non-decreasing sequence a 3 

1 L_1 / 
lim — > a-; f 1 — 



(6.13) 



2C E« 



L ^°° L j^o V (pi : 2(E^) 3 + E^-E^)L 
2(C-C l)E , 



(pi, 2 (Ec) 3 + E^ - e?)L 

L-l 

: 

< 



r 1^ (, 2dE^ V 

L Too L A, a i [ L (p 1>2 (E,)3 + E, 2 - E ? )£ J 



Indeed, assume for contrary that 

L-l 



iim )y 



, , 2dE ? 
a,- 1 - 



££c Lj~^ J V (Pi,2(E?) 3 + E^ 2 - E^)L 
2(C-C l)E , 



(6.14) 



(pi, 2 (Ec) 3 + Ec 2 - E?)L 

L-l 

1 

> 



r i f ^ 2d Eg V 

L a -> ^ (p li2 (Eg) 3 + E, 2 - E<r)lJ 

ly!/ 2(C-d)Ec y 

(Pi,2(E^) 3 + E<r 2 — E<j)L/ 
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Then, applying inequality f|6.9|) to the right-hand side of (|6.14|) . we obtain: 



(6.15) < li-,7E% 1™ tEI 1 



lim )V 1 



L ' ■ 2(C-Ci)Ecr 
x " 



L ^ ooL j^\ (Pi,2(E0 3 + E^ 2 -Ec)L 



lim — a, lim — | 1 



L ^ J l^oo L ^\ (pi 2 (E<;) 3 + E<r 2 - E?)L 



Since the left-hand side of (16. 14)) is 



lim — a., f 1 



L ^°° L ft V (pi, 2 (E0 3 + E^ 2 -E<r)i 



(see relation (16.111) ), then comparison of the last obtained term in (|6.15l) with the 
left-hand side of (|6.14[) enables us to write: 



L 1 ' K 'Ei. 



lim — a, [ 1 



L ^°° L ft V (pi, 2 (E0 3 + E<; 2 -E0i 



> Z5 flj ^i§r (? ll2 (E03 + E^-E0i ) 



3=0 3=0 



The contradiction with basic inequality (|6.9p proves (|6.13p . 
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Taking into account (|6.12p and (|6.13[) . the extended version of (|6.10|) after an 
application of ()6.9[) now looks 



1 L 1 / 2CE<; 
L ' 2CiE? 



lim — V" c L -j ( 1 



L ^°° L j=d V (pi,2(E?) 3 + E^ 2 - E?)i 
/ 2(C-d)E g V 

1 ^ / 2CiE^ 



3=0 
1 1,-1 

X l" 1 ^ I V/ (i?l,2(E?) 3 + E^ - E?)I 
11 ' 2CiE<; 



V(Ci) lim I £ ( 1 



x 



1 ' ■ 2(C-d)E? 



lim - V [ 1 - 



i^L^l (p li2 (E0 3 + E^ 2 - E?)i 



On the other hand, the right-hand side of (|6.5[) can be rewritten 



3.17) x 1 - 



2(C-Ci)E? 



(pi, 2 (E0 3 + E? 2 - Es)L 



X 



1 ' ' 2(C*-C 1 )E<r 



lim I V(l- 



l^ooL^V (pi, 2 (E0 3 + E<r 2 -E0i 



The last equality in f|6 . 1 7[) is the application of (|6.12p . From (|6.16[) and (|6.17[) we 
hnally obtain ip(Ci) < i/j(C) for any positive C\ > C. 

The first statement of Lemma 16.21 is proved. The proof of the second statement 
of this lemma is similar. □ 



In the following we need in a stronger result that is given by Lemma 16721 Namely, 
we will prove the following lemma. 
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Lemma 6.3. If the sequence {a} contains at least two distinct values, then the 
function ip{C) is a strictly decreasing function, and the function 77(C) is a strictly 
increasing function. 

Proof. In order to prove this lemma it is sufficient to prove that if the sequence 
{ci} is nontrivial, that is there are at least two distinct values of this sequence, 
then for any distinct real numbers C\ 7^ C2 the values of functions are also distinct, 
that is, ip(Ci) 7^ VKC2) and rj(Ci) 7^ 77(62). Let us prove the first inequality: 
t/>(Ci) ^ tp(C 2 ). Rewrite (JfiHJ) as 



the numerator does exist and bounded, since the sequence {c^} is assumed to be 
bounded. As well, according to the other representation following from Lemma |6. II 
and relation (j5.3[) , it is an analytic function in C taking a nontrivial set of values. 

The analytic function t/>(C) is defined for all real C > and it can be extended 
analytically for the whole complex plane. Namely, for real negative values C we 
arrive at the function 77(C) = ip(—C). According to the maximum principle for the 
module of an analytic function, if an analytic function takes the same values in two 
distinct points inside a domain, then the function must be the constant. If c; = c* 
for all i = 1,2,..., then this is just the case where tp(C) = c* for all C. If there 
exist io and i\ such that Ci a 7^ Cj 15 then the function ip(C) cannot be a constant, 
because the analytic function is uniquely defined by the coefficients in the series 
expansion. So, the inequality ip(C±) 7^ tpi^) for distinct values Ci and C2 follows. 
The proof of the second inequality i](Ci) 7^ 77^2) is similar. □ 

We are ready now to formulate and prove a main theorem on optimal control of 
the dam model considered in the present paper. 

Theorem 6.4. Under the assumption that the costs Ci are not increasing, and under 
additional mild conditions of Theorems \4-3\ and \4-4\ there is a unique solution to 
the control problem. The solution to the control problem is defined by choice of the 
parameter p\ as follows. 

Let C be the minimum value of the functional J u PP er defined in (I5.2[) and (I5.3[) 
and, respectively, let C be the minimum value of the functional J lowcr defined in 
(|5.4[) and (|5.5[) . Then at least one of two parameters C or C must be equal to zero. 

(1) In the case C — and C > 0, the solution to the control problem is achieved 
for px = 1 — 5, where positive 5 vanishes such that 5L — > C as L — > 00. 

(2) In the case C = and C > 0, the solution to the control problem is achieved 
for p± = 1 + S, where positive S vanishes such that SL — > C as L — > 00. 

(3) In the case where both C = and C = 0, the solution to the control problem 
is pi = 1 . 

Proof. Note first, that under the assumptions made there is a unique solution to 
the control problem considered in this paper. Indeed, a solution contains two terms 
one of them corresponds to the expression for p\J\ + P2J2 in (|1.2p and another 



(6.18) 




The limit of the denominator 




The limit of 
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^uppcr 

one corresponds to the term c i1i m (HHJ)- The first term of a solution is 

related to the models where the water costs are not taken into account, while the 
additional second term is related to the extended problem, where the water costs 
are taken into account. 

In the case where the water costs are not taken into account, the existence of a 
unique solution to the control problem for the particular system in [2] follows from 
the main result of that paper. The same result holds true for a more general model 
with compound Poisson input flow but without water costs included. The last is 
supported by Theorems 13.101 - 13.131 which are similar to those Theorems 4.1 - 4.4 
of [2]. 

In the case of the dam model, where the water costs are taken into account, 
the second term in the solution is either c uppcr or c lowor . According to Lemma [67TI 
c upper _ ^,(£7) anc j c iower _ fj((J), and according to Lemmas I6.2l and f6.3l the function 
?/>(C) is strictly decreasing in C, while the function 77(C) is strictly increasing in 
C, and ip(0) = 77(0) = c*. According to these properties, there is a unique solution 
to the control problem considered in the present paper as well, and it satisfies the 
following properties. 

In the case where the both minima of J u pp ci ' and J lowor are achieved in C = 0, 
that is both C = and C = 0, then c uppcr = c lowcr = c* and the term Pl J x + p 2 J 2 
of the objective function in (jl.2j) coincides with the term 

. pi, 2 (EQ 3 + Ec 2 -E g . P2 pi, 2 (EQ 3 + E<r 2 - 
Jl 2E<? 32 \-p2 2E<? 

in (|5.1j) . That is both the minimum of J u PP er and that of J lowcr are the same, and 
they are equal to the right-hand side of (|5.1|) . In this case the minimum of the 
objective function in (|1.2p is achieved for p\ = \. 

If the minimum of J lowcr is achieved for C — C_ > 0, then, since r/(C) is strictly 
increasing, we have c lowcr > c* , and hence the term p\J\ + P2J2 of the objective 
function in (|1.2p satisfies the inequality: 

, , , . pi, 2 (E<r) 3 + E^-Ec . p 2 p li2 (E0 3 + E<; 2 -E^ 

PlJl +P2J2 < Jl— r= h 32- tf ■ 

2E<^ 1 - p 2 2E<r 

This implies that J lower is less than the right-hand side of (|5.ip . As well, in this 
case c upper < c* , and the minimum of J u PP cr must be achieved for C = C = 0. In 
this case the minimum of the objective function in (|1.2[) is achieved for pi = 1 — 8, 
where positive 5 vanishes as L — > 00, and LS — > C_. 

In the opposite case, if the minimum of J u PP cr is achieved for C — C > 0, then 
the arguments are similar to those above, and J u pp 01 ' is not greater than the right- 
hand side of (|5.1[) . The minimum of J lowor must be achieved for C = C = 0. In 
this case the minimum of the objective function in (|1.2p is achieved for p\ = 1 + 5, 
where positive S vanishes as L — > 00, and Lb — > C . □ 



From Theorem l6.4l we have the following evident property of the optimal control. 

Corollary 6.5. The solution to the control problem can be pi = 1 only in the case 
jl ^ 32 i- 2 p2 ■ Specifically, the equality is achieved only for Ci = c, i = 1, 2, . . . , L, 
where c is an arbitrary positive constant. 
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Although Corollary 16.51 provides a result in the form of simple inequality, this 
result is not really useful, since it is an evident extension of the result of [2]. A more 
constructive result is obtained for the special case considered in the next section. 

7. Example of linear costs 

In this section we study an example related to the case of linear costs. 
Assume that c\ and cl < c\ are given. Then the assumption that the costs are 
linear means, that 

i — 1 

(7.1) Ci = ci - — (ci - c L ), i = 1,2, 

It is assumed that as L is changed, the costs are recalculated as follows. The 
first and last values of the cost c± and cl remains the same. Other costs in the 
intermediate points are recalculated according to (|7.1I) . 

Therefore, to avoid confusing with the appearance of the index L for the fixed 
(unchangeable) values of cost C\ and Cl, we use the other notation: C\ = c and 
cl = c. Then (17.11) has the form 



(7.2) c t = c~ i_L(c-c), i = l,2,...,L. 

Li — 1 

In the following we shall also use the inverse form of (|7.2[l . Namely, 

(7.3) c L ^ = c+-^-(c-c), i = 0,l,...,L-l. 

Lj — 1 

Apparently, 
(7.4) 

For c upper we have 

c u PP cr = 



C + C 



L-l 



= lim J 



J r- s\ (, 2 ^ 



E \c + -r^{c-c) i- 



L—l -7 V (?i, 2 (E?) 3 + E^ 2 - E?)L 



L^oo L-L ( 2CEC 



J=0 



(p li2 (E0 3 + E^_E^)L 



(PLafEcja + E^-EOL 



. , ,. 1 j"=0 
(7.5) =c+(c-c) hm -■ 



(^(E^ + E^-E^L 



>, 2 (EQ 3 + E^ 2 -E<; 
= £+(c - £) 2CB= 



2CE^ / 2CE<j 

ex P ~ TITas i r,9 FT - 1 



pi, 2 (EQ 3 + E<; 2 - E^ " Vpi.2(EQ 3 + E^ 2 - E^ 

exp U, 2 (eo 3 + e, 2 -eJ - 1 

For example, as C converges to zero in (|7.5j) . then c uppcr converges to c+ ^(c — c) 
c* . This is in agreement with the statement of Proposition 15.11 
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c lowcr = ^ 



L-1 



= lim J 



j r- ^^ ( , , 2CE^ 



L-V "V V (?i,2(E?) 3 + E^ 2 - Es)L 



L— >oo L—l 

E 



(7.6) = c + (c - c) lim 



2CE<; 



(p li2 (E0 3 + E^_ E ^)L 
2CE<r 



L-1 

E i 



(p li2 (E0 3 + E^-E^)L 



L^oo L — l L-1 

E 



2CE<j 



c+ (c — c) 



P!, 2 (E^) 3 + E^ 2 - E^ 
2CE^ 

2CE<j / 2CEc 

— 1 + cxp 



p 1 , 2 (EQ 3 + E^-E^ "V p 1>2 (E^) 3 + E^ 2 -E^ 

1 — exp — ; 



Pi, 2 (E^) 3 + E^ 2 - E?, 
Again, as C converges to zero in (|7.6I) , then c lowor converges to c + | (c — c) 



So, we arrive at the agreement with the statement of Proposition l5.il 

We cannot give the explicit solution because the calculations are very routine 
and cumbersome. However, we provide a numerical result. For simplicity, the input 
flow in the numerical example is assumed to be ordinary Poisson, that is we set 
Ec = 1 and E<j 2 = 1 in our calculations. 

Following Corollary 16.51 take first j-y = j 2 \ ■ Clearly, that for these relation 
between parameters j\ and j 2 the minimum of J lowor must be achieved for C = 0, 
while the minimum of J u pp ci ' must be achieved for a positive C . Now, keeping j\ 
fixed assume that j 2 increases. Then, the problem is to find the value for parameter 
j2 such that the value C corresponding to the minimization problem of J u PP er 
reaches the point 0. 

In our example we take j\ = 1, p% = | , c = 1, c = 2, pi j2 = 1. In the table below 
we outline some values j 2 and the corresponding value C for optimal solution of 
functional J u PP or . It is seen from the table that the optimal value is achieved in 
the case j 2 « 1.34. Therefore, in the present example j\ = 1 and j 2 w 1.34 lead to 
the optimal solution pi = 1. 
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